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The problem of optimum reception of binary sure and Gaussian signals 
is to specify, in terms of the received waveform, a scheme for deciding be- 
tween two alternative mean and covariance functions with minimum error 
probability. In the context of a general treatment of the problem, this article 
presents a solution which is both mathematically rigorous and convenient 
for physical application. The optimum decision scheme obtained consists 
in comparing, with a predetermined threshold c, the sum of a linear and a 
quadratic form in the received waveform x(t); namely, choose m (t) and 
r (s,l) if 

2Jx(t)g(t) dt + f f[x(.8) - mi(s)]h(s,t)[x(t) - nti(t)] ds dt < c, 

choose nti(t) and ri(s,t) if otherwise, where m (t), mi(l), r (s,t) and ri(s,t) 
are the two mean and covariance functions, and g(t) is the square-inlegrable 
solution of 



/• 



r (s,t)g(s) ds = m\{t) — m (t), 
while h(s,t) is the symmetric and square-inlegrable solution of 

n(s,u)h{u,v)i\{v,t) du dv = n(s,t) — r (s,t). 



II' 



Note that under the assumption of zero mean functions, i.e., m (l) = 
Wi(i) = 0, the above result is reduced to the one in a previous article by 
this author, while with the assumption of identical covariance functions, i.e., 
r Q (s,i) = ri(s,t), it is reduced to the classical result essentially obtained by 
Grenander. 

Sections I and II introduce the problem and summarize the main remits 
ivith certain pertinent remarks, while a detailed mathematical treatment is 
given in Section III. Although Appendices A-D are not directly required 
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for solution of the ■problem, they are added to provide a tutorial background 
for the results on equivalence and singularity of two Gaussian measures ob- 
tained by Grenander, Root and Pitcher as well as some generalization of 
their results. 

I. INTRODUCTION 

Suppose the received waveform x(t) observed during the interval 
^ t ^ 1 is the sample function of a Gaussian process, whose mean and 
covariance functions are either m (t) and r (s,t) or mi(t) and ri(s,t). We 
assume that m (t) and nti(t) are continuous while r (s,t) and r,(s,0 are 
positive-definite as well as continuous. Denote by H k , k = 0,1, the 
hypothesis that m k (t) and r k (s,t) are the mean and covariance functions 
of the Gaussian process {x t , ^ t ^ 1}. Suppose further that a, < a 
< 1, and 1 — a are the a priori probabilities associated with the two 
hypotheses H and Hi respectively. Then, reception of binary sure and 
Gaussian signals may be regarded as a problem of deciding between two 
hypotheses H and Hi upon observation of the sample function x(t) . Thus, 
the problem of optimum reception of binary sure and Gaussian 
signals is to specify a decision scheme in terms of x(t) such that its error 
probability is minimum.* 

In the previous article, 1 a general treatment of the problem was made 
under the assumption that m (t) = m,(0 = 0, and several forms of the 
optimum decision schemes were given under additional conditions with 
varying degrees of restriction. The following is most restrictive but most 
convenient for physical application: 

choose Ho if / / x(s)h(s,t)x(t) ds dt < k, 

Jo ^o (1) 

choose Hi if otherwise, 

where h(s,t) is the solution of the integral equation.! 

7 

'o •'o 
satisfying 



/ / r (s,u)h(u,v)ri(v,t) du dv = n(s,t) - r (s,t) (2) 



f [ h\s,t) dsdt < «>, (3) 

^0 •'0 

and k is a positive constant (the predetermined threshold) ; provided the 

* A more complete motivation of the problem is given in Ref. 1. 
t Existence of such a solution is a part of the condition for (1) to be the opti- 
mum decision scheme. 
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following additional conditions are satisfied for all ij = 1,2, • • • . 

^ K, (4) 



xT " 8ij 



00 / 

a <i > £ I a 'J 1 1 

where X< , i = 1,2, • • ■ , are the eigenvalues of the co variance kernel 
r (s,0 and a,-, ; ?'j = 1,2, • • • , are defined by 

a.j = / / ^i(s)ri(s,t)\f/j(t) ds dt, 

*"0 •'O 

with ypiit), i = 1,2, • • • , being the orthonormalized eigenfunctions cor- 
responding to X, , i = 1,2, • • • , and K is a constant independent of i 
and j, and the prime above the summation sign signifies omission of the 
term j = i or k = j, whichever the case may be. 

As remarked in the previous article, the conditions (4) are not essen- 
tial to the nature of the problem but are imposed for the sake of mathe- 
matical proof. Moreover, they are undesirable from the application 
viewpoint since they not only are restrictive but also require the explicit 
knowledge of the eigenvalues and eigenfunctions of the kernel r Q (s,t). 
Recently, Rao and Varadarajan 2 * and Pitcher 3 have obtained certain 
general results (on the expression of Radon-Nikodym derivatives), which 
indicate that such conditions are unnecessary and can be replaced by 
more meaningful ones. In fact, Rao and Varadarajan extend to the gen- 
eral case where the assumption m (() = m-\(t) = is no longer made. The 
purpose of this article is to generalize the previous results 1 by removing 
the assumption m (l) = m,i(t) = and replacing the conditions (4) with 
more appropriate ones. The first half of the development is a direct gen- 
eralization of the former Solution — I (the "sampling" approach), while 
the second half is the application of the results of Grenander 4 and Pitcher 
to the problem of optimum reception. f 

II. SUMMARY AND DISCUSSION OF MAIN RESULTS 

As previously stated, 1 the foundation for solution of the problem of 
optimum reception consists of the following (measure theoretical) facts: 

* This article appeared even before the author's previous one. 1 although the 
current result as well as the previous one were obtained independently. 

t The results of Grenander and Pitcher are better suited for this problem than 
those of Rao and Varadarajan since the former readily yield a concrete specifica- 
tion of the optimum decision scheme comparable to (l)-(3). Although the problem 
stated at the beginning is solved by a particular combination of Grenander's and 
Pitcher '8 result, we have added in appendices an extension of Pitcher's results on 
equivalence and singularity of two Gaussian measures to the general case where 
»«o(0 5"* ^ m\(t) for its own interest. 
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(1.) Two Gaussian probability measures P and Pi , corresponding 
respectively to m (t) and r (s,t) and to m x {t) and r x (s,l), can be either 
"equivalent" or "singular". 

(2.) If P and Pi are equivalent, then there is a certain random variable 
dPi/dPo called the Radon-Nikodym derivative of Pi with respect to P , 
which is a function of the sample function x(t), and the following decision 
scheme yields the minimum non-zero error probability : 

choose H if -r^r- (x) < 



dP v * 1 - a ' ( 5 ) 

choose Hi if otherwise. 

On the other hand, if P and Pi are singular, then there is a set N of 
sample functions such that P (N) = and Pi(iV) = 1, thus the error 
probability of the following decision scheme : 

choose Ho if x(t) does not belong to N, 

(6) 
choose Hi if otherwise, 

is exactly zero, regardless of the a priori probabilities, thus resulting in 
the case of "perfect reception". 

Hence, the problem of specifying the optimum decision scheme be- 
comes the problem of finding such a random variable dPJdPo and a set 
N as well as a criterion to tell whether P and Pi are equivalent or 
singular. 

2.1 Solutions — / 

Suppose x(ti), • • • , x(t n ), ^ ti < ••■ < t n ^ 1, are the values of 
the sample function (the received waveform) sampled at h , ••-,/„, 
where each sampling interval is to become infinitesimal as n — > <*> . Like- 
wise, let m (ti), •■ • , mo(t n ) be the sampled values of m (t). Then, the 
joint probability density functions for x(ti) — m (ti), ••• , x(t n ) — 
m (t n ) under the two hypotheses H and Hi are obtained by using the 
mean and ovariance functions m (t) and r (s,t) (under H ) and mi(t) 
and ri(a,0 (under Hi).* Then, by forming the ratio of the two density 
functions, the likelihood ratio l n of x(h) — m (ti), ■ • • , x(t n ) - m Q (t n ) 
is obtained as follows: 

* A rather artificial choice of x(U) — mo(U), instead of x(U), i = 1, • ■ • , n, is 
purely for a notational convenience later, and other choices are equally accepta- 
ble at this point. 
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l n (x) = | Ro^iRi™)- 1 1* exp [i £ [x ti - m (U)] 

\_l ».,-i 

X [(/2o (n) )~' - (J8i w r1« [x ti - moitj)] 

where ft i t <n, , fc = 0, 1, are n X n eo variance matrices defined by 

(Rk n) )a = r k (U , tj), k = 0, 1; i,j = 1, • • • , n. 

Next, through the use of martingale theory, the following facts can 
be established : 
.To and P\ are equivalent (the case of non-perfect reception), if and only if 

lim |tr[fl <n, (fti ln, r' - 2/ + fl^WV + (fl (B> ) _1 M (n) 

(8) 
+ (fi l ( " , ) _1 M (n) ] | < oo, 

where (Jlf )»v = w*<»ly ; ij = 1, • • • , n, and m,- , t = 1, • • • , n, are 
given by 

m, = mi(/,-) — mo (£,•)• 

In this case 

lim l n (x) = jjp (*) (9) 

n-»« aXo 

for almost all sample functions under both hypotheses H and H x . 

Po and Pi are singular (the case of perfect reception) if and only if (8) 

is not satisfied. f In this case, for almost all sample functions, 

(0 under Ho , 
oo under Hi . 

That is, (8 ) is a necessary and sufficient condition for the perfect recep- 
tion to be impossible. The crucial random variable dPi/dPo , by which 
the optimum decision scheme is specified in this case, can be expressed 
as the limit of the likelihood ratio l n (x) for almost all sample functions 

* "tr" denotes "trace", and I is the n X n identity matrix. 
t In this case, the left-hand side of (8) becomes + «> necessarily. 
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x(t). Likewise, negation of (8) is a necessary and sufficient condition for 
the perfect reception to be possible, and the critical set N can be speci- 
fied as the set of all sample functions for which the limit of the likelihood 
ratio is not smaller than any positive constant, say a/(l — a). Therefore, 
we conclude, in conjunction with (5) and (6), that irrespective of 
whether or not the condition (8) is satisfied, the optimum decision 
scheme can be specified as follows: 

choose Ho if lim l„(x) < 



1 - a' (10) 

choose Hi if otherwise. 

We note in (8) that, if m (t) = m l {t) = 0, the trace of the last two 
terms in the bracket vanishes, thus the necessary and sufficient condition 
for equivalence of Po and Pi is reduced to 

lim tr[B. ( " ) («i ( " ) )- 1 - 27 + ii! 1 (n, (fl. (n, )1 < -, (U) 

which agrees with the previous result. 1 Similarly, if r (s,t) = n(s,t) = 
r(s,t), the trace of the first three terms vanishes and the necessary and 
sufficient condition is reduced to 

lim tr[(i2 (B) ) _1 M (n) ] - lim (m (n) , (R (n) y l m w ) < », 

„-.» n-°o 

where m (n) = (w,- , • • • , m n ). 

Now, since the trace of the last two terms in the bracket of (8 ) is al- 
ways positive as indicated above, (11) is a necessary condition for (8). 
Also, since the left-hand side of (11 ) is known to be either finite or + oo , 
the conditions 

lim tr[(R k w r l M {n) ] < «, k - 0,1 (12) 

are necessary for (8). Thus, we conclude that a necessary and sufficient 
condition for equivalence of Po and Pi is that P and Pi be equivalent in 
the following three special cases: 
(i) nto(t) = mi(t) = 0, 
(ii) r (s,t) is substitued for ri(s,t), 
(iii) ri(s,t) is substituted for r (s,t).* 

* It can easily be shown that the cases (ii) and (iii) can be combined to the 
case (iv) where r (s,t) + ri(s,t) is substituted for both r (s,t) and fi («,*)■ Thus, 
the necessary and sufficient condition for equivalence of P and Pi becomes that 
they be equivalent in the special cases (i) and (iv). This condition has already been 
reported elsewhere. 2 ' 8 Furthermore, as it turns out, either the case (ii) or the case 
(iii) is redundant. That is, P and Pi are equivalent in general if they are so either 
in the special cases (i) and (ii) or in (i) and (iii), as shown in Appendix D. 
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It may be illuminating to rephrase this in terms of the perfect reception 
of binary (sure and Gaussian ) signals, though the use of terms is slightly 
inconsistent with the remainder of this article. Suppose we consider 
mo(t) and m\(t) as binary sure signals and ra(s,t) and ri(s,t) as the 
covariance functions of binary Gaussian signals or noise whichever the 
case may be. Then, the perfect reception of the binary sure and Gaussian 
signals is possible if any one of the following three conditions is satisfied 
by the constituent signals and noise: 

(i' ) the perfect reception is possible between the two Gaussian signals 
alone, 

(ii' ) the perfect reception of the binary sure signals is possible in the 
presence of the Gaussian noise with the covariance function ro(s,t). 

(hi') the condition identical to (ii') except for r (s,t) being replaced 
byri(s,t). 

Examination of the form of the likelihood ratio l n in (7) in conjunc- 
tion with the decision scheme (10) indicates that, if the exponent and the 
factor before the exponential converge separately, (10) can be rewritten 
in terms of their limits. Namely, if there exist a positive constant /? and 
a random variable such that 

/3 = lim \Tti n \Rf*T l \ t (13) 

n-»°o 

and 

(n)\-l / D (n)\-li 



0(x) = lim 



E \x ti - moiu)] [M n) r l - (Rrr% 

l_ i.y-i 



v r /, vi i v» ( ™>o(U) + Tlll(U)\ / 1A v 

X YXtj - nio(lj)\ +2 2, [x ti g 1 (14) 

X [(Olvlm^y) - mo(tj)] , 

for almost all sample functions under both hypotheses Ho and .Hi , then 
(10) is reduced to the following: 



Gtefl. 



choose Ho if 6{x) < log | - 

choose Hi if otherwise. 
It can be shown that such /3 and 6 exist if and only if 

lim | trtfi^WV - I + (fii"")" 1 M {n) ] | < oo, 

n-»co 

lim I tr[Bi (w) (ffo (B) )~' - / + (Ro^r 1 M M ] | < oo. 



(15) 



(16) 
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Note that the above implies the condition (8) as it should. In fact the 
condition (16) requires not only that the sum of two traces should con- 
verge but also that the two traces should converge individually. As we 
have observed earlier, the condition (8) is equivalent to those of (11) 
and (12). Hence, the portion of the condition (16) which is additional to 
(8) is 

lim|tr[tfo (n W"T l - /]| < », 

n-»oo 

(17) 
lim|tr[ft 1 (n) («o <n) )~ 1 - J] | < oo. 

n-»co 

But, according to the previous result, 1 (17) is the necessary and sufficient 
condition for existence of /3 and 8 when m (t) = mi(t) = 0. This is no 
surprise. For, according to (9), l n (x) converges for almost all sample 
functions under both hypotheses when the condition (8) is satisfied. 
Hence, if in addition the factor before the exponential converges, the 
exponential must also converge (for almost all sample functions). Thus, 
the additional condition required is the convergence condition of the 
factor before the exponential alone. But this factor is obviously inde- 
pendent of m (t) and m,i(t). In summary therefore, if and only if the 
conditions (12) and (17) are satisfied, there exist such /3 and 8 as defined 
by (13) and (14) and the optimum decision scheme can be specified by 
(15). 

Although the decision scheme (15) is certainly simpler than (10), it 
is still inconvenient for physical application since it requires the limit 
operation for each received waveform. What is highly desirable is to 
express 8 of (14) not in terms of the infinite sum but in terms of integrals 
involving x(t) explicitly. It is completely possible to achieve this ob- 
jective through a straightforward generalization of Solutions — II of 
the previous article 1 by removing the assumption m (t) = m\{t) = 0. 
But, as we have remarked in the Introduction, this method cannot avoid 
the undesirable accompanying conditions analogous to (4). Hence, in 
the next subsection, we shall obtain the expression of dPi/dPo directly 
through a particular combination of the results of Grenander and 
Pitcher. 

2.2 Solutions — // 

Let us introduce a third Gaussian probability measure Pio correspond- 
ing to mi(t) and ro(s,t). Then, just as equivalence of P and Pi implies 
existence of a random variable dPi/dP (the Radon-Nikodym deriva- 

* This generalization has been carried out in detail and the result is contained 
in an unpublished article by this author. 
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tive of Pi with respect to P ) as stated at the beginning of Section II, 
equivalence of P and Pio and equivalence of P 10 and Pi imply existence 
of dPio/dPo and dl\/dP w respectively. Now recall that the key to the 
solution is to find an expression of dPi/dPa in terms of x(t), in the case 
where the condition (8) is satisfied. Note that the term, Radon-Nikodym 
derivative, and its symbol immediately suggest the following formalism 
which is analogous to the chain rule in calculus: 

dP 1 = dP L dPio (18) 

dP dP 10 dP ' 

According to measure theory, P and Pi are equivalent and (18) is valid 
for almost all sample functions under the hypotheses H Q , H x0 and Hi , 
if P and P i0 as well as P i0 and Pi are equivalent. Thus, the task of find- 
ing an expression for dPi/dP in terms of x(t) is equivalent to that of 
finding such expressions for dP 10 /dP and dPi/dP 1Q together with the 
conditions for equivalence. 

Now, through the application of the condition (8) to the case of two 
Gaussian measures P and P 10 , it is seen that P and Pio are equivalent 
if and only if (12) with k = is satisfied. Note that this is the special 
case (ii) in the preceding subsection, namely, that perfect reception of 
the binary sure signals m (t) and mi(t) is not possible in the presence of 
Gaussian noise with the covariauce function r (s,t). Then, according to 
Grenander, 4 if the integral equation 

( r (s,t)g(s)ds = mi(0 - m Q (l), ^ / ^ 1, (19) 

•Ml 

has a square-integrable solution g(i), then dPio/dP can be expressed as 

^= (*) = exp {{ [*(() - W0 ± mM ] gU) di] (20) 

for almost all sample functions under the hypotheses H and #io . As 
we may recall, it is through the substitution of (20) into (5) that the 
well-known optimum receiver (decision scheme) of binary sure signals 
in noise is obtained; namely, 

choose Ho if 

f x(t)g(t) dl < i ( [m (0 + wi(0M0 di + log =-2— , (21) 
choose //,o if otherwise. 



* //io is the hypothesis that mi(() and r {s,t) are the mean and covariance func- 
tions of the Gaussian process \xt ,0 = t ^ 1\. 
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Similarly, from the condition (8), two Gaussian measures Pio and Pi 
are equivalent if and only if (11) is satisfied. This is essentially equal to 
the special case (i), namely, that the perfect reception is not possible 
between two Gaussian signals with r Q (s,t) and n (s,t), where x(t) — rtii (t) 
instead of x(t) is to be regarded as the sample function in this case. 
Then, according to the previous result, 1 which is improved by Pitcher, 3 
if the integral equation (2) has a solution h(s,t) which is symmetric and 
satisfies (3), dPi/dP i0 can be expressed as 



£w-(jj*)"*-p{Jjfjfw.> 



— mi(s)]h(s,t)[x(t) — irii(t)] ds dt 



(22) 



for almost all sample functions under the hypotheses H i0 and Hi , where 
Pi > 0, i — 1,2, • • • , are the eigenvalues of a certain operator defined in 
terms of ro(s,t) and ri(s,t). As in the preceding case, it is seen that sub- 
stitution of (22) into (5) yields the optimum decision scheme (1). 

In summary, therefore, if the integral equations (19) and (2) have a 
square-integrable solution g(t) and a symmetric and square-integrable 
(in the sense of (3) ) solution h(s,t) respectively, then the crucial random 
variable dPi/dPo can be expressed as the product of the right-hand sides 
of (20) and (22) for almost all sample functions under Ho and Hi . 
Thus, the desired optimum decision scheme becomes the following: 

choose Ho if 

2/ x(t)g(l) + / / [x(s) - mi(s)]h(s,t)[x(t) - mi(t)] ds dt 

J o ■'o Jo 

r> n/ vi (23) 

< J o [mo(t) + mi (t)]g(t)dt + log I $(j-^-) J . 
choose Hi if otherwise, 



where 



■ = n 



pi 



i=i 



It should be remarked that the indices and 1 can be consistently in- 
terchanged throughout. This follows from the symmetry of the problem 
with respect to the indices. Moreover, by virtue of the symmetry of 
h(s,() in s and I, the indices on the left-hand side of (2) can be inter- 
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changed while the right-hand side remains unchanged. We also remark 
that the solutions g(t) and h(s,t) of the integral equations (19) and (2) 
respectively are unique under the constraints of square-integrability for 
g(l) and symmetry and square-integrability in the sense of (3) for h(s,t). 

Physical interpretation of the optimum decision scheme (23) is ob- 
vious, at least, in principle. Given two alternative mean and covariance 
functions m (t) and r (s,t), and wii(f) and ri($,t), the optimum receiver 
consists of a linear and a quadratic filter whose impulse responses are 
g(t) and h(s,t), respectively, and whose inputs are 2x(t) and x(t) — m,i(t) 
respectively. The outputs of the two filters are sampled at the end of 
the observation interval, and the decision is made by comparing the sum 
of the two sampled outputs with the predetermined threshold c, namely, 
the right-hand side of the inequality in (23). 

Finally, although somewhat redundant, it seems instructive to ex- 
amine the optimum decision scheme in the two special cases which have 
already been considered. 

Casel: 

r (s,t) = r,(s,t) = r(s,t), 

namely, the case of reception of binary sure signals m (t) and wii(0 m 
the presence of Gaussian noise with the covariance function r(s,t). In 
this case, the second integral in the inequality of the optimum decision 
scheme (23) vanishes, since the right-hand side of the integral equation 
(2) becomes identically zero, thus yielding the identically vanishing 
function as the only solution satisfying the conditions of symmetry and 
square-integrability (3), i.e., h(s,t) = 0. Moreover, /3 becomes unity 
since all p, , ?' = 1,2, • • • , are unity. Hence, the optimum decision scheme 
(23) is reduced to that of (21) where g(t) is the square-integrable solution 
of (19) with r (s,l) replaced by r(s,t). 

Case 2: 

m (t) = mi(t) = 0, 

namely, the case of reception of binary Gaussian signals with the covari- 
ance functions r (s,t) and ri(s,t). In this case, the first and the third 
integrals in the inequality of (23) vanish, since the right-hand side of 
the integral equation (19) becomes identically zero, thus admitting the 
trivial solution as the only square-integrable solution, i.e., g(t) = 0. 
Hence, the optimum decision scheme (23) is reduced essentially to (1). 
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III. MATHEMATICAL THEORY 

3.1 Statement of Problem 

Definitions 

Let £2 be the space of all real- valued functions o>(- ) on [0,1], and let 
x t (-) be a real- valued function denned on ft such that the value of 
Xt(-) at co is equal to o)(t). Let (B be the a-field generated by the class of 
all sets of the form 

{co: (£,», ••• ,*,>)) € A], (24) 

where n and ti 6 [0,1], i = 1, • ■ ■ , n are arbitrary and A is any n-di- 
mensional Borel set. Finally, let A , Ao and A be Gaussian measures 
induced on (B respectively by m and r Q , by mi and r , and by mi and 
ri , where m* , k = 0,1, are real-valued, continuous functions on [0,1], 
while rk , k = 0,1, are real- valued, symmetric, positive-definite, con- 
tinuous functions on [0,1] X [0,1].* Then, x t is obviously (B-measurable 
for every t 6 [0,1], thus \x t , ^ t ^ 1} is a real Gaussian process whose 
finite dimensional distributions are given by the values of A , Ao and 
A on the set defined by (24). Since m k and r k , k = 0,1, are continuous, 
there always exists a separable (with respect to all A , Ao and A ) and 
measurable version of {x t , ^ t ^ 1}, which we denote by \x t , ^ 
t ^ 1} .f Let 03 be the minimal cr-field with respect to which x t is measur- 
able for every t € [0,1], and let P , Pio and Pi be the restrictions of A , 
Ao and A respectively on (B. 

Next, define a set function P a (A),0 < a < 1, A 6 (B, by 

P„(A) = aPo(A) 4- (1 - a)Pi(fl - A). 

Let A a be such a set that 

P a (A a ) ^ Pa(A) for all A 6 (B. 

Problem 

Given a, < a < 1, specify such a set A« in terms of x t . 



* See Ref . 5, pp. 609-610 and p. 72. 

t Let P be a probability measure _on (§ with respect to which all Po , Pio and 
Pi are absolutely continuous, e.g., P = % (Po + Pio + Pi). Now continuity of 
m* and r* , k — 0,1, implies continuity in probability of x t on [0,1] with respect to 
Po , Pio and P t , hence with respect to P. Then, there exists a separable (with 
respect to P) and measurable version of {xt »0 ^ t :£ 1}, (see Ref. 5, pp. 54-59). 
But, because P , Pio , Pi « P, the same version is separable with respect to P , 
Pio and Pi also. 
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3.2 Solution 

Preliminaries 



The foundation for solving the above problem consists of the following 
two measure theoretical facts: 

(a. ) The Gaussian measures P and Pi can be either equivalent, P = 
Pi , or singular, P J_ Pi ■" ' ' ' 

(b.) If F„ = P, , then A„ = L: ^ (») ^ -?—] , 

{ dPo I — a) (25) 

if Po _L Pi , then A« = N, 

where dPi/dPo is the Radon-Nikodym derivative of Pi with respect to 
Po and N is a (B-measurable set such that P (N) = = Pi(Q - N). 1 
Thus, the problem stated in the preceding subsection is reduced to 
that of finding dPi/dPo if Po = Pi and JV is Po _|_ Pi , which are expres- 
sible in terms of Xt . 

Solutions — / 

Let [t/c] be a sequence of points in [0,1], which is dense in [0,1]. Let 
(B„ be the minimal <r-field with respect to which all x u , i = 1, • ■ ■ , n, 

are measurable, and let (B„ be the minimal o--field containing U (B„ . 

.1=1 

Obviously, 

(B, <Z (B 2 C • • • C (B„ C (B. (26) 

Then, since \x t , £ t ^ 1} is continuous in probability (with respect 
to Po), it follows that, for every set A (E (B, there exists a set A 6 (Bw 
such that 

Po(AAA') = 0. (27) 

Now, from the fact that m* and r* , k = 0,1, are two alternative mean 
and covariance functions of [xt , ^ / ^ 1}, the density functions p 
and pi of the random variables x Ti (<a) — wio(r,), i = 1, ■ ■ ■ , n, corre- 
sponding to Po and Pi respectively, are obtained as follows: 



Also see Theorem 3 in Appendix D. 
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PoU , • • • , *) = (2rr n ' 2 I Ro M I -1 exp |~- 1 £ Vi [(Ro M r% r/| , 
PiU, •••,*„) = (27r)- n/2 I «i (n) I"' exp 

[- ^ Z x (* - »n) [(i2i (B) ) _1 ]tf(^ - «/)] , 

where i^t (n) , /c = 0,1, are n X n symmetric, positive-definite matrices 
defined by 

(Rk M )ii = r k {n , ry), k = 0, 1; ij = 1, • • • , n, 

and 

mi = mi(Ti) — wio(r,-), £ = 1, • • • , n. 

Then, define a random variable l n by 

I ( \ = pi[xri(e>) — moJTi), • ■ • , x Tn (u)) — m (T n )] 
p [x 7l (w) — m (Tj), • • • ,x rn (ci>) — m (T„)] 

= {Ro^iRi^T'fexph i: M«) - ^"(r,)] 

X [(Bo 00 )" 1 - (fi 1 (B> )" 1 ]^ M«) - mo(ry)] (28) 

I V^ r / N »Io(t<) + mi(r,') I r/p (n)N-l-l 

+ 4- «r*( w ) O 7 

X Emi(ry) — m (Ty)] . 

Note that Z„(o>) ^ for all n, and pi = whenever p = and vice 
versa. Hence, the processes {Z„ , n ^ 1} and {l/l„ , n ^ 1| are martin- 
gales with respect to Po and Pi respectively.* Then, lim Z„ exists a.e. 

n-»« 

(Po) and is denoted by U , and also lim l/l n exists a.e. (Pi).f Further- 

more, it can be shown that 

(i) if P = Pi , then (26) and (27) imply 

L = §? q , a.e.(Po), (29) 

(ii) if Po ± Pi , then 

Po({u:limUco) ^ c}) = = Pi({a>: lim l n (<a) < c}) (30) 

for an arbitrary constant c > O.J 

* See Ref . 5, pp. 91-93. 
t See Ref. 5, p. 319. 

t See Ref. 1, pp. 2783-2784. Although the definition of l n is slightly different 
from the one in Ref. 1 the derivation procedure is identical. 
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Thus, upon combination of (29) and (30) in conjunction with (25), 
the desired set A a can be given by 



A a = lu): lim 7„(w) ^ 



1 - a 



irrespective of whether P = Pi or P _L Pi . 

Under certain restrictive conditions, the set A a can be specified in 
terms of well defined functions of x t . It is of interest to obtain such 
specifications as well as the accompanying conditions in terms of the 
given mean and covariance functions ra* and r k , k = 0,1. 

If P = Pj , it has already been shown that 



A* = lu>: Uu) ^ 



1 - 



Furthermore, it can be shown through the use of martingale theory that 
P m Py if and only if (8) is satisfied.* 

Next, examination of (28) indicates that, in addition to the condition 
(8), if there exists a positive constant /3 such that (13) holds, then there 
exists a random variable 6 such that 



d(u>) = lim 



V [xrM - mo(r,)] [(«o (n) )- 1 - (fli 00 )- 1 ],. 



X [x Tj M - mo(rj)] + 22 (»,,(« 



) - 



Wo(t,-) + rtii( 



2 



a) 



X [(Bi w )~ l ]« bm(ry) -mo(r,)]l, a.e.(P ). 
Thus, the set A„ can be specified as follows: 

a. -{«•(.) s log IXf^)]}- 

It can be shown through the use of martingale theory that the conditions 
(8) and (13) are equivalent to those of (lC).f 

Solutions — 77 

Let R and Ri be the integral operators whose kernels are ro and r x 
respectively, that is, for any real-valued function /, 

* See Ref. 1, pp. 2784-2785, with the definition of U replaced by (28) of this ar- 
ticle. 

t See Ref. 1, pp. 2786-2787, with the definition of /„ replaced by (28) of this ar- 
ticle. 
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(Rtf)U) = I r k (s,t)f(s) ds, 0£t£l, k = 0,1, 

J o 

whenever the right-hand side is well defined. Then, Grenander shows 
that* 

if there exists g £ £ 2 (0,l)f satisfying the integral equation (19), then 

P = P 10 and 



£[•■ 



dP w f/*T mo(0 + mi(t) 

dp; ' exp 



g(t)dt), a.e.(P„). 



On the other hand, according to the previous result, improved by 
Pitcher,! 

if there exists a symmetric function h on [0,1] X [0,1] satisfying (3) 

and the integral equation (2), then Pio = Pi and 

^- = | #„"'' RiRo~* I" 1 exp (iff [x, - roi(s)]M*,0 

(1,1 in \i Jo Jo 



10 



X [x t - nn(t)] ds dt\ , a.e.(Pio)§. 



Since P = Pio and P i0 = Pi imply P = Pi and 

a.e.(P ), 



dPi dPi dP w 



dP dP l0 dP ' 

we conclude that 
if there exist g € £ 2 (0,1) satisfying (19) and symmetric h satisfying 
(3) and (2), then P = Pi and 

jp = \Ro RiRo I exp < J x t 5 0^) <» 

+ 1 f [ [x. - mi(s)]h(s,t)[xt - mi(t)) ds dt\ , a.e. (P ). 
2 *"o J o J 

Therefore, through the substitution of the above into (25), the desired 
set A a can be specified as follows: 

* See Appendix B. 

t £2(0,1) is the space of all square-integrable functions on [0,1]. 

j See Appendix C. 

§ I R<r i RiRo~ i I = II Pi where pi , i = 1, 2, • • • , are the eigenvalues of 
t=i 
ito ~'RiRo~ • 
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A„ = la: 2 J x t (u)g(t) dt 

+ / / [x,(o)) — mi(s)]h(s,t)[x t (co) — mi(t)] ds dt 

^ f Q [m (t) + rmUMt) dt + log \TZr~) I R ^ R i R °~' If • 

if there exist g £ £2(0,1) satisfying (19) and symmetric h satisfying 
(3) and (2). 
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APPENDICES 

These appendices are given primarily for a tutorial reason. The ma- 
jority of the theorems and lemmas here are taken from two articles by 
Root 9 and Pitcher, 3 in the original, modified or extended forms.* Lemmas 
1, 2, and 3 are in the original modified and extended form respectively. 
Theorem 1 is supplemented by (iii) and a corollary. A more sig- 
nificant supplement, however, is in its proof. While the extended portion 
of Lemma 4 is a routine matter (hence its proof is omitted) , Lemma 5 is 
significantly extended and strengthened. Lemmas 6 and 7f are added as 
a supplementary part of the proof of Theorem 2. Although Theorem 2 
is stated somewhat differently and in much more detail, its main content 
remains the same. While the first corollary to Theorem 2 is almost 
obvious, the proof of the second is considerably involved and is given as 
"Theorem 3" in Ref. 3. Lemmas 8 and 9 and Theorem 3, which is a gen- 
eralization of Theorems 1 and 2, are the author's addition. However, 
their major contents have already been reported elsewhere in different 
forms, e.g., Ref. 2, including the two corollaries to Theorem 3. 



* The term "extended" refers to the extension of the results in Refs. 9 and 3 
to the case where the assumption wo = wii = is no longer made. 
t The proof of Lemma 7 is supplied by both Root and Pitcher. 
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APPENDIX A 



Preliminaries 



Let p and p be probability measures defined on a o--field J of subsets 
of an infinite set (uncountable in general). Let p and £ be the completions 
of p and n on o-fields J p and j M respectively. 

Lemma 1: Let Jo be a a-field such that 

Jo CZ J p and J C J„ , 

and Ze£ po am/ po be the restrictions of p and p on Jo . Then, 

Po -L Mo => p -L p. 

Lemma 2: A ssume 

Po = po • 

Le< Jo be a <r-./ieZd 0/ sete 0/ the form A A iV, A 6 Jo , p(iV) = 0. 

J C Jo. 

Lei p'o and p be the restrictions of p and p. on 'So, and let p and p be £/je 
restrictions of p and p on J. TTien, 

(z) p = p and p = p , 
(») p = V, 
(Hi) Jo = J P = J M > 

, ... dp. d/jo 1 x 

ap apo 

Lemma 3: Let di , 6 2 , • • ■ , be a sequence of Gaus sian variables ( J-raeas- 
urable) with respect to both p and p sncA //iai 

EM = 0, EM = v ti 

E^BiOi) = Ufa, EJ(6i - vi){dj - Vj )} = Ma, 

where E p and E„ denote the expectations with respect to p and p respectively 
and cti , @i , i = 1,2, • • ■ , are arbitrary positive numbers. Let J be the 
minimal a-jield with respect to which all 0, , i = 1,2, • • • , are measurable, 
and let p and p be the restrictions of p and p on J. Then, 

(i) either p = p or p _L p, 
(it) p = p. if and only if 



U'-t) 



— — 1 < =° and 2s ; — t < * • 

,=1 a, + Si 
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(Hi) if p = A, 



g— {sbg-k)*- + s(— 5) + *-d}- 



dp 

dp 

a.e. (p). 



Proof: 

(i) Let J7, , z* = 1, 2, • • • , be the minimal cr-field with respect to 
which 6i is measurable, and let p (,) and p (,) be the restrictions of p and 
p on &, . Then, from the hypothesis of the lemma, 

p = p , 7 = 1, 2, • • • , 

and 

t=i i=i i=i 

Hence, the assertion (i) follows from Kakutani's theorem.* 
(ii) From the hypothesis of the lemma, 

C-fe) , -G(=-s)* ,+ s*-s]' a - w - (31) 

Thus,f 

•(27ra,)" 5 exp(- -£- )# 



9 



«i 



(4a f -j8,-) 1 / 1 Vi 



exp 



2 



(ff,- + /3.-)» K \ 4a,- + ft 
Note, for allt = 1, 2, • • • , 

? ^ N2 < 1 and 0<exp(-±-^- > )<l. 
Hence 

converges to a positive number if both 

* See Ref. 9, pp. 295-296. 

t Ef (i) denotes expectation with respect to $ (i) . 
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Uw+W' and §S7Tft- 

converge. Therefore, according to Kakutani's theorem, = p. if and 

only if these infinite product and sum converge. 

Now, 



n 



4tt.fr 



=1 (a* + ft) 2 
converges if and only if 

£[!- jggi 1<oo. 

But 

i _ _j?a_ _ A _ *Y /(i + sY 

and the infinite sum of this converges if and only if 



U i -t) 



■1 



hence, the assertion (ii) follows, 
(iii) Note 

n j a ( » 



HmSS ~ MS 



IJJ,-), a.e. (0). 



f4 rfp (i) ' l^P 

Hence,* 

Then, the assertion (iii) is obtained through substitution of (31) into 
the above. 

APPENDIX B 

First Theorem on Equivalence and Singularity 

Theorem 1: (Grenander) 

(i) Either P m P 10 or P _L Pio , 
(ii) P = Pio if and only if R Q ~ l m £ £ 2 (0,1), 
(iii) if Pa m P 10 , 

* See Ref. 11, p. 381. 
t See Ref. 5, p. 331. 
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dP 10 
dP 



= -{life 4 '-fl}' a - e - (P ° } - 



where m(t) = m x (t) — m (t), ^ / ^ 1, and £, and v t , i = 1, 2, 
are defined by 

&•(«) = (&(») - mo,<Ai) = I Ma) - m (t)]fr(t) dt, 

-'o 

a.e. (Po,Pic) 

v, = {m#i) = [ m(t)fa(t) dt. 

Proof: Let P n and Pio be the completions of P and P 10 on (B/» and (B/. in 
respectively. Then, from the definition, fe, i = 1, 2, • • • , are measurable 
with respect to both (B/>„ and & Pl0 , and Gaussian distributed with re- 
spect to both P and P, u such that* 

A'oU,! = A'.oU, - Pt) = 0, 

A'oU.y = £?»{({, - *)(& - ?,)} = Ms*. 

Furthermore, a modified version of Kauhunen-Loeve theorem f holds; 
namely, for every t £ [0,1], 

n 

Xi - mo't) = lim £ friMO, a.e. (P ). (32) 



Now, let (B/, % « 1, 2, • • • , bs the minimal <r-field with respect to 
which £, is measurable, and let 

«' = n «/■ 

Then, 

ffi/ c m Po , ffi,' e ® Pl0 , ffl' a (B Po , «' c <B/> I0 . (33) 

Let Po' 1 " and Pi,,' 1 " be the restrictions of P and P X o on ffl/, and P„' 
and Pio' on ffi'. Then, it is readily seen that P /(,> = Pm ' , i = 1, 2, • • • , 
and 



dP 



<II>, 



?*■ = cxp L-ix: _ ^xr J = exp k fe ^ 2X-J ■ a - e - ( Po> - 



* J?u , #10 and /?i denote expectations with respect to Pa , Pio and Pi in general. 
However, if the function whose expectation is in question is (B -measurable, the 
same symbols are used for expectations with respect to Po , Pio and Pi also. 

t See Ref. 1, pp. 2801-2802. 
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Hence, 

I ®w) ! -*• - **•)-■ L - fe f - S - (- £) * 
= exp (- fe) • 

Thus, 

Hence, from Kakutani's theorem, either 

P„' = P 10 ' or iV ± Pio, (34) 

and Po = Pio if and only if 

=o 2 

Z^<°o, i.e., R ~*m € £ 2 (0,1). (35) 

i=l A, 

Next, for an arbitrary t 6 [0,1], define 
r, = la: x t (u) - m (t) = £ &(u)ft(f)|, 

A, = {o>:a- t (co) - mo(0 € A], a/ = L: g fc(»)fc(0 € A 
where .4 is an arbitrary Borel set. Put 

a, = (a, n r.) u (a, n m, a/ = (a/ n r t ) u (a/ n r/). 

Then, from (32) 

a, fl r, = a/ n r, , p (a, n iY) = o = p (a/ n iY). 

Hence, 

Po(A, A A/) = 0. 
Let ffi' be a cr-field of sets of the form a' A N, K 6 (&', Po(N) = 0. Then 

A« € $',0 £ f £ 1. 

That is, Xi — mo(t) is (B -measurable for every t 6 [0,1]. Hence, .T t is 
(B -measurable for every t. But, since 63 is the minimal a-field with re- 
spect to which x t is measurable for every t, we have 

<B C «'. (36)* 

(ii) Necessity: Assume Po = Pio. Then, P = Pio, thus P ' =Pio'- 



* This part of the proof, i.e., establishment of (36), is not given in Ref. 4. In 
fact, Grenander's assertion is only on the primed measures Po and Pio' . 
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Hence, from (35), 

Ko"*m 6 £ 2 (0,1). 

Sufficiency: Assume R ~ m £ £ 2 (0,1). 

Then, from (86), Po' = Pio'. Then, from Lemma 2 (ii) together with 
(30), 

Po = PlO . 

(i) Dichotomy: Assume P and P 10 are not equivalent. Then, 
from (ii), R*~ k m £ £ 2 (0,1). Hence, from (35) and (34), P„' ± Pj. 
Then, from Lemma 1 together with (33), 

Po_L P10. 

(iii) Radon-N ikodym Derivative: From (ii) and (35), Po = P10 => 
P ' = P 10 '. Then, from Lemma 2 (iv) together with (30), dP l0 /dP = 
dPio/dPa, a.e. (Po). Then, the assertion follows from Lemma 3 (iii) 
with a, = /3, = X, , / = 1, 2, • • • . 

Corollary {Grenander): 

IfRo^m € £2(0,1), //tew Po = Pioanrf 

dPio ( wio + wii D -1 \ „„ / p n 

— ^ = cxp ( ;c - ^ , Po ml, a.e. (P ). 

Proo/: The first assertion is obvious from Theorm 1 (ii) since 
Po _1 m € £2(0,1) =* Po _i m G £ 2 (0,1). 
To prove the second assertion, note that 

Then, from (32) and the definition of v» , * = 1, 2, ■ • • , 

(x - ^±^ , Po-'m) = lim (± (fc - f) h , Po-m) , 

a.e. (Po). 



APPENDIX C 



Second Theorem on Equivalence and Singularity 

Lemma 4: If either Pi J Po -i or Po 3 'Pi -i is unbounded, then P 1_ Pi and 
P,o J_ Pi • 
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Lemma 5: If R\ JBo is bounded and Ro~*m £ £2(0,1), then, for any se- 
quence of functions f ,- € £2(0,1), i = 1,2, • • • , there exists a corresponding 
sequence of Gaussian variables 0, , i = 1, 2, ■ • • , (measurable with re- 
spect to (R/.,, , (Rp,„ and (9> Pl ) such that for i, j = 1, 2, • • • , 

Eo{6 { + v% ] = En\6i) = E l {6 i \ = 0, 

So{ (6 i + wi)(fii + »,)) = E^Otj] = (/,,/,), (37) 

E 1 {e i t j \ = (f it x*xfj), 

where X is the bounded extension of R^R ~' to the whole of £ 2 (0,1) and 
Vi , i = 1, 2, • • • , are defined as 

v, = (/, , R ~'m). 

Proof: Since /?o* (£ 2 (0,1 ) ) is dense in £ 2 (0,1), there exists a sequence 
\fij\i for each /, • , i = 1, 2, • • • , such that 

fto"*/« £ £ 2 (0,1), j = 1, 2, • • • , and lim ||/, - f ti || = 0, 

j-OC 

where ||/|| is the norm of/ in the space £ 2 (0,1). Then, through ele- 
mentary steps, it can be shown that 

lim (/,„,,/,„) = lim lim (/*»,/,„) = (/.-,/,). (38) 



fi->co m-*oo 



1° Let 8,j ; i,j = 1,2, • • • , be (B-measurable functions such that 

da = (x - mi, R ~*fij), a.e. (P u ,P V) ,Pi). 

Then, there exist random variables 0,- , i = 1,2, • • • , which are measur- 
able with respect to (R Po , (Bp 10 and (Bi>, , and Gaussian distributed with 
respect to Pa , Ao and Pi such that 

0, - l.i.m.0 o , (Po,Pio,Pi). 

y-»oo 

To prove 1°, consider expectation with respect to P , P i0 and P x of 
I On - e ik | s = 0,/ - 20„-0« + 6ik\ i = 1,2, • • • . First, note 

#o{M«} - $>1 (Ro^fij, x - m - m)(x - m - m, «o _5 /,a)I 

= (RfT% t R a Ro~%) - (flo""*/,i,ro)(fi ~V«,wO. 
Thus, from (38), 

lim tfo \6ifiu) - lim [(/<,,/«) - (/,>, Ro"*m )(/,-,, #o _1 m)] 

= 11/.- II 2 " Ui,R^rn)\ 
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Hence, 

lim E n { \Bu - d ik U = 0. (39) 

M-» 00 

Secondly, note 
\imEio\dijda] = lim (R<r%,RoRfT%) = lim (/</,/«) = ||/, || 2 . 



Hence, 



lim #i„{ | »,-> - 0,i | 2 } = 0. (40) 

y,fc-»«o 



Thirdly, note 

AIM*) -*l(BrV«.iWfc"V»)I = (Xf ij: Xf lk ). 
Since X is hounded, it is continuous. Thus, from (38), 



Hence, 



lim (Xf u ,Xf«.) = ||A7,-|| 2 . 



lim #i{|0 tf - 0*f| - 0. (41) 

y,fe-*°° 



Next, upon combination of (39), (40) and (41), {0,,},- , * = 1,2, • • • , 
are seen to be mean fundamental sequences with respect toPo + Pio + Pi. 
Hence, there exist 0, , ?' = 1,2, ■ ■ • , measurable with respect to (Bp +J , io+J , i 
such that 

0, = l.i.m. 0,,-, (P„ + Pio + Pi). 

But, since this implies 

6i = l.i.m. Bn , (Po , Pio , Pi), * = 1,2, 

,•-.00 

f , i = 1,2, • • • , are measurable with respect to (B Po , ®p 10 and (R P , , and 
are Gaussian distributed with respect to P , Pio and Pi . 
2° To prove (37), simply note 

E {0, + vi) = lim^ o {0,y| + n 

,-.00 

= lim Eo[(x — m — m, &>/»/)) + v< ~ 0, 

y-oo 

#i„{0,) = limtfmK) - 0, 
y-*« 
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Ei{e ( } = KmEiiOij) = 0, 
E [(6i + Vi){6j + vs)) = lim lim E {(e im + Vi ){6 jn + Vj )\ 

n-»co jn-»« 

= lim lim (R<T*f im , RoRo^fj,,) 

n-*» m-»« 

^10 {^-} = lim lim E w {e im e jn ) 

= lim lim (R ~ h f im ,R Ro~%) 

n-»co m-»w 

tfi{0&) = lim lim EdeM 

n-*=o m-»ce 

= lim lim ( Ro~ h fim , RiRo~ h fj n ) 

= (Xf^Xfj), 

where (38) is used for the last three calculations. 

Remark 1: The assertion of Lemma 5 with respect to Pio and Pi only, 
is valid without the condition R^m 6 £ 2 (0,1). 

Remark 2: Suppose R m C £2(0,1) but there exist a sequence \fa\j 
for each/,, i = 1,2, ••• , such that /2 ~% G £ 2 (0,1),./' = 1,2, ••• 

lim || fi — fa || = 0, lim (m, Ra~ h fij) = v! 

/-.CO J-.00 

for some real number v, . Then, Lemma 5 is still valid if Vi is replaced by 
vl, i= 1,2, ■■• . 

Remark 3: Suppose Ro~ m $ £ 2 (0,1 ) and there is no such sequence. Then, 

Po X Pi . 
Proof: Let 

vn = (m, fio~*/.i); i,j = 1,2, • • • , 
where 

Km ||/,- -fij\\ = 

for each i = 1,2, ■ ■ ■ . Without loss of generality, we assume that 
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lim | va | = °° 

for some i. Define for such i, 

hi = Oi,/vij, J = 1,2, ••• • 
Then 

Et>[hi + 1} = Ei&d =0, j = 1,2, 
Put 

a J = E4(0 iS + l) 2 !, a J = Bi[faf\. 
Then, 

lim vif = 0, k = 0,1. 

Thus, there exists a subsequence {o- lJn } such that 

00 

S »#»* < °°i A; = 0,1. 

n=l 

But, from Tchebycheff inequality, we have for some e, < e < - , 
Po({»: |^(«)| < e}) < Po({o>: |0, 7 » + 1 | ^ e) ) ^ ^° , 



£" 



07 



Pi(|«:|^y.(co)| ^ e}) ^ ^l. 

Hence, by Borel-Cantalli lemma, 

P (liminf„{w: |§,-,- n (w)| < e}) g P (lim sup n {a>: | 0,/„(o>)| < e} ) = 0, 

Pi(limsup»{w: |0.,„(w)| ^ e} ) = 0. 

Hence, by noting that 

lim sup„ }w: | 0,;„(o>)| ^ e| = Q — lim inf B {w: | 0,y„(co)| < e}, 

we have 

Po X Pi . 

Lemma 6: If I — R ~*RiR ~ 2 is a densely defined, bounded, completely 
continuous operator on £ 2 (0,1), then 



- mi.t) = lim [f; (R '<Pi)(t) Vl + f) 02i*fc)(0fc , (nXP 

m,n-»=o |_i=i i = \ 



.) 
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where <pi , i = 1,2, • • • , are the orthonormal eigenf unctions corresponding 
to nonzero eigenvalues of I — R ~ 1 RiRo~' and <p { , i = 1,2, • • • , are an 
orthonormal basis of the nidi space of I — R 'R1R0 \ and 77,- and 77, are 
defined by 

r)i = l.i.m. (x — mi , R ~ <Pa) , 

(Po.Pio.Pi), 
rfi = l.i.m. (x — mi, So £»•), 

where <ptj , ipa £ £ 2 (0,1); i,j = 1,2, • • • , are chosen in such a way that 
Ro^tpn , fio~*ftj € £2(0,1) and, for each i, 

lim |[ y,- — v.y II — 0) lim II <Pi ~~ <pu II = 0, 

/-»» i-» 

and finally m is Lebesgue measure on Borel field & of the subsets of [0,1]. 

Proof: Note that <pi and fr , t = 1,2, • • • , exist since / — Ro^RiRo'* is 
densely denned, bounded, self-adjoint and completely continuous. 
Consider 



t -1 I to n 

I m .n = EiA \xt - im(0 - E (Ro<Pi)(t)vi - E (Ro%)(t)v, 

[Jo I i=l '=1 

By expanding the bracket, 

-1 m /•! 

/»» - / r (M) dt-2Yj \ (Ro<Pi)(t)E 10 {[x t - mi(t)hi) dt 

Jo i— 1 J 

- 2 E f (J2oV*)(0#io{[*i - mi(0ta} * 

,=1 ''0 

+ 2 E E ^loUwi (floV.- , a**) 



dt). 



1=1 i=i 



+ E ^ w { V Mj i (#0 V i > RoVi ) + E ^m { V iT)j ){Ro<Pi, Row ) • 



Note 



£»{[zi - mi(i)ta) = Eiolli.m. / (So W)(»)b. - mi(s)] 



[.C( — Wli(01 ds 



* If the null space is finite dimensional, then {£,•] can be incorporated into 
{^,-J and there is no need to treat {£,•} separately. 
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= lim (RoRo~W)(0 

= (i2oVi)(«); 

similarly, 

#io{fr, - mM\U = (R %)(t). 
Also, from Remark 1 of Lemma 5,* 

Eio\iliVi) = {<P< » »i) = 0, 
^?io{ if »i?i) = (v. f f»y) = hi > 

Therefore, 

Im.n - / r (M) d< - E (<Pi>R&i) ~ E (v,,R&i)- 
Now, 

-1 CO 

/ r (/,0 d/ = Z\ t . 

•'O k=l 

On the other hand, 

oo CO CO oo 

E (<p,,Rwi) + 2 (<pi,R#pi) = ZZ (¥>i,^k)(RvfPi,^k) 
i=i i=i i=i t=i 

00 00 

, = 1 A = l t=l *=1 

= ExJe (*■■,**)' h-EC^iM 1 ! 

ib-i L<=i < =1 J 

= Ex*-. 



Hence, 



lim / m .„ = 0. 

m,n-» » 



* Note that, it RrT i RiR(T h is densely defined and bounded, then iJi'fto - ' is 
bounded. 
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Lemma 7: Under the hypothesis of Lemma 6, 



where (B is a a- field of sets of the form A A N, A 6 (B, Pw(N) = 0, and 
($3 is the minimal a-field with respect which all 77, and 77, , i = 1,2, • • • , are 
measurable. 

Proof: It suffices to prove that x t is ©-measurable for every t £ [0,1], 
since © is the minimal a-field with respect to which x t is measurable for 
every t. 

1° Xt is ©-measurable for almost every t (with respect to ^t). 
To prove 1°, define 

n 

»»(*,«) = E [(*•*«) (0*(») + («oV.)(Or],(co)]. 

i=l 

Then, from Lemma 6, there exists a subsequence {s nk (t,co)\ which con- 
verges to x t — mi(t), a.e. (n X P10). Namely, if 

D = {(t,(ti):x t (a) — mi(i) 9^ lim s nb (t,<a)} , 

ft-* 

then 

D € ax (Bp 10 and ( M X P W )(D) = 0. 
Hence, from Fubini's theorem,* for almost every t 

Pu(D t ) = 0, 

where D t is the section of D determined by t. In other words, s nk (t,co) 
converges to Xtiu) — m\(t), a.e. (P10), for almost every t. Then, since 
each s nk (l,o)), k = 1,2, • • •, is ^-measurable for every t, an argument 
analogous to the one in the proof of Theorem 1 (p. 1642) shows that 
A t = {u:x t ((>)) — mi(t) € A] is ©-measurable for almost every t, where 
A is any Borel set. Namely, x t — titi(t) and, hence, x t are ©-measurable 
for almost every t. 
2° Xt is ©-measurable for every t. 

To prove 2°, let T 6 fl be a set of t for which x t is ©-measurable. 
Then, n(T) = 1. Since r is continuous on [0,1] X [0,1] and T is dense 
in [0,1], there exists for every t 6 [0,1] a sequence {t n }, t„ 6 T , converg- 
ing to t such that 

lim E w { J si - wi(0 - x tn + mi(0 | 2 } = 0. 



See Ref. 10, p. 147. 
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Hence, there exists a subsequence { t» k } such that 

lim [x, n — nti(t„ t )] = Xi — m x (t), a.e. (Pio). 

fc-W * 

Then, since each x tl — mi(t„ k ), k = 1,2, • • •, is ©-measurable for every 
t, the same argument used above shows that A, is ©-measurable for 
every /. Namely, x t — mi(t) and, hence, x t are ©-measurable for every 
t 6 [0,1]. 

Theorem 2 (Pitcher): 

(i) Either P l0 = Pi or P„ ± P x , 

(ii) Pio = Pi if and only if I — Ro^RiRtT 1 is a densely defined, 
bounded, completely continuous, Hilbert- Schmidt operator on £2(0,1), 
(Hi) t/Pio= P,, 



dP 10 



= lim exp <- y\ ( 1 - -J rii - log p,- >, a.e. (P w ) , 



where pi , i = 1,2, • • • , are the eigenvalues of R ~'RiRo . 
Proof: 

(ii) Necessity: Assume P 10 s Pj . 

Then, from Lemma 4, Ri'Rq~' is bounded. Hence, / — RqRiRo" is 
densely denned and bounded. 

The above statement implies that # -fti-Ro is self-adjoint and 
positive-definite, and its bounded extension to the whole of £ 2 (0,1) is 
equal to X*X. Let / vdP v be the spectral representation of X*X. We 
now show by contradiction that X X has a purely discrete spectrum. 
Suppose for some e > 0, / — J\ +e is infinite dimensional. Then, there 
exists a sequence {i» t -}, 1 + 8 22 i* < v% < • • • , and a sequence of ortho- 
normal functions/, £ £2(0,1), i = 1, 2, ••• , such that 

Cft« + , -^. )/.=/.. (42) 

Hence, from Remark 1 of Lemma 5, there exists a sequence of random 
variables 0, , i = 1,2, • • • , which are measurable with respect to ©/.,„ 
and (B/., and Gaussian distributed with respect to both P w and Pi , such 
that 

tfioM = EM = 0, 
EwlBiOj) = (/«,/,) = Si,-, 

EtlOfij) = (fi,X*Xfj) = ha P" wd{fuP4<) fc (1 + e)Atf. 
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Let (B* be the minimal <r-field with respect to which all 6 { ,i_= 1,2, ■ • • , 
are measurable, and let P x * and Pi* be the restrictions of Ao and A on 
CB*. Then, from Lemma 3, Pio* _L Pi*. It follows then from Lemma 1 
that Pio _L Pi , which is a contradiction. Therefore, / — P 1+B is finite 
dimensional for every e > 0. Similarly, it can be shown that Pi_ E is 
finite dimensional also. Hence, X*X has a purely discrete spectrum, and 
1 is the only limit point of the spectrum. Hence, / — X*X is completely 
continuous,* and so is / — Ro~*RiRo . 

It follows from the preceding paragraph that the eigenvalues and the 
corresponding eigenf unctions, p, and <p; , i = 1,2, • • ■ , of Ro RiRo 
exist. Then, according to Lemma 5, 17, and t), , i = 1,2, • • • , defined in 
Lemma 6 have the following properties: 

ExM = EMi) = EiM = EM*] = 

EwlViVj] = (<P>,<Pj) ~ &<j 1 

EMViVA = (<Pi . <f>i) = 5 '> ' 

EiMi) = (v>i,<Pi) = 0, (43) 

EilviVj] — (<Pi , Ro 'RiRo Vj) = p$ij ■> 

EiiviVi] = (<Pi , Ro *RiRo 'ipj) = 5,j 

Etlvivj] = (<Pi , R*~*RiRo~*to) - (<Pi,<Pj) = 0. 

Let Ao and A be the restrictions of Ao and Pi on (B. Then, since p, > 
0, i = 1,2, • • • , it follows from Lemma 3 that either Ao ■ A or Ao -1- A , 
and Pio = Pi if and only if 

£ (l - -Y < 00 . (44) 



=1 \ p 

Furthermore, from Lemma 1, Ao _L A => Pio X Pi • But, since Pio = Pi 
from the hypothesis, we must have Ao = Pi • Hence, (44) is satisfied, or 
equivalently, 

Ed- P.) 2 < »• (45) 

1=1 

Namely, / - R^RiRr* is of Hilbert-Schmidt type. 

Sufficiency: Assume that / - R Q ~ i RiRo~ i is a densely defined, 
bounded, completely continuous, Hilbert-Schmidt operator on £ 2 (0,1). 
Then, Pi'Po - * is bounded, and P ~'PiPo _i is self-adjoint and positive- 

*See Ref. 12, pp. 234-2.35. 
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definite. Thus, we establish 77, and rji , i = 1,2, ••• , and (43) as previ- 
ously done. Now, since / — R<T*RiRo~* is of Hilbert-Schmidt type, (45) 
is satisfied, and so is (44). Then, since p, > 0, i = 1,2, • • • , it follows 
from Lemma 3 that P 10 = A . Then, from Lemma 7 and Lemma 2 (ii), 

P10 = Pi . 

(i ) Dichotomy: Assume that P10 and Pi are not equivalent. Then, 
one of the following three cases must hold : 

(a) I — RtT^RiRiT* is either not densely defined or unbounded, or 
both, 

(b) it is densely defined and bounded, but not completely continuous, 

(c) it is densely defined, bounded and completely continuous, but 
not of Hilbert-Schmidt type. 

In case (a), RiRo~ is unbounded. Hence, from Lemma 4, P 10 _L Pi . In 
case (b), X*X has a spectral representation, and either / — P 1+E or 
Pi_ c must be infinite dimensional for some e > 0. Then, P 10 * ± Pi* and, 
hence, P l0 _1_ Pi , as shown in the necessity part of the proof of (ii). In 
case (c), / — Ro~ RiRo~ has the eigenvalues and eigenfunctions 1 — p, 
and <pi , i = 1,2, • • • , and there are the associated Gaussian variables 
77, and iji ; , i = 1,2, • • • , as described previously. But since I — P -i P^iPo~ 1 
is not of Hilbert-Schmidt type, (45) and, hence, (44) do not hold. Then, 
according to Lemma 3, P10 _L Pi . Then, from Lemma 1, P10 _L Pi . 
Therefore, we conclude that if P 10 and Pi are not equivalent then they 
must be singular. 

(ii) Radon-Nikodym Derivative: The assertion (iii) is an immediate 
consequence of Lemma 3 (iii) with v t = 0, i = 1,2, ■ ■ ■ , and Lemma 2 
(w). 

Corollary 1 : If P\o = Pi and 

|E(1 - fii ) <», 
then 



dP x 

dP l0 



(n,.) _i exp[l|;(l-i),r], a.e.(P 10 ). 



Proof: Note that 77, ; , i = 1,2, • ■ • , are mutually independent Gaussian 
variables with 

Eu[m) = 0, E 10 \ V , 2 } = 1, E 10 {vi 4 ) = 3. 



* Note this trivially implies that if P\ and Pi are not singular, then they must 
be equivalent. 
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Hence 

i 17 i\ .11 IA/ A 





§*•{('■ 


-JMI-lsO- 


a 


s Ei ° K 1 ■ 


-5)M-s('- 


-a 


Therefore,* 









Then, the assertion follows upon combination of the above and Theorem 
2 (in). 

Corollary 2 {Pitcher): If there exists a bounded, self -adjoint operator H on 
£ 2 (0,1) satisfying 

RoHRt = R i HR = R x - fto , (46) 

then 

P10 s -Pi 

and 

^ = (ll pA exp [§(a; - m,, //(.r - mi)], a.e. (P 10 ). 
ttjrio \»— 1 / 

APPENDIX D 

Third Theorem on Equivalence and Singularity 

Lemma 8: P10 _L Pi => Po ± Pi . 

Proof: If P10 ± Pi , it follows from Theorem 2, (i) and (ii), that one 
of the three cases (a), (b) and (c) listed in the proof of Theorem 2 (i) 
holds. 

In case (a), Ri h R ~ h is unbounded, then P _L Pi according to Lemma 
4. 

In case (b), at least, either I — Pi +E or Pi_ e must be infinite dimen- 
sional for some e > 0, as shown in the proof of Theorem 2 (ii). Suppose 
/ — P 1+B is infinite dimensional. Then, there exists a sequence of ortho- 
normal functions/, , i = 1,2, ■ • • , satisfying (42). Hence, according to 
Lemma 5, there exist a corresponding sequence of Gaussian variables 

* See Ref. 5, p. 108. 
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8i , i = 1, 2, • • • , such that 

E {Bi + ,/) = EM = 0, E { (0, + vi)(fii + p!)] = 8a, 

EABidj] = (f i ,X*Xf J ) ^ (l + e)5,y, 

provided that either R ~ m 6 £2(0,1) or there exists a sequence {fn\j, 
i = 1,2, ■ • • , satisfying the conditions of Remark 2 of Lemma 5. Now, 
let (B be the minimal er-field with respect to which all 0,- , i = 1,2, • • • , 
are measurable, and let Po and Pi be the restrictions of Po and Pi on 
(B*. Then, from Lemma 3 and the above result, it follows that Po* _L Pi*. 
Hence, from Lemma 1, Po _L Pi . On the other hand, suppose neither 
Ro m € £2(0,1) nor there exist such a sequence {/,,} ,• for some i. Then, 
from Remark 3 of Lemma 5, Po _L Pi also. 

Similarly, if Pi_ c is infinite dimensional, it can be shown that P _L Pi . 

In case (c), we can assume existence of the Gaussian variables rj ,- 
and iji , i = 1,2, • • • , with the properties (43) and the following: 

-EoW.+T.I = W, + 7.} = 0, 

Eol (Vi + 7.) (n + 7i)l = E Q { (n + y t ) (^ + y;)\ = Sij , (47) 

^o{(r 7 , + 7i)(^ + 7y)} = 0, 

where 7* = (<Pi , Ro m), 7,- = (<£,• , Ro m), i = 1, 2, • • ■ . 

Since / — #o~ R%Ro~ is not of Hilbert-Schmidt type, (45) does not hold. 
Thus, (44) is not satisfied. Hence, from Lemma 3, Po A. Pi. Then, from 
Lemma 1, Po _L P\ . 

Lemma 9: P _L P10 => Po _L Pi . 

Proof: Since P ± P10 , there exist a non-empty set A 6 (B such that 

Po(fl - A) = and Pio(A) = 0. 
Now, if P10 = Pi , then Pi (A) = 0. Hence, we have 

Po(fi - A) = and Pi (A) = 0, 

namely, Po _]_ Pi . If P 10 and Pi are not equivalent, then they must be 
singular according to Theorem 2 (i), i.e., P10 _L Pi . Then, from Lemma 
8, Po J_ Pi . 

Theorem 3: 

(i) Either P = Pi or P ± P, , 
(it) Po = Pi if and only if 
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(a) I — Ro~*RiRq~* is a densely defined, bounded, completely con- 
tinuous, Hilbert- Schmidt operator on £ 2 (0,1), 

(b) R<T h m € £ 2 (0,1), 
(in) ifP = Pi, 

•exp |g [ 7 * (* + ^) + 7* (w + |)]} , a.e. (A). 

(Remark) Note it follows from Theorems 1 and 2 that the necessary 
and sufficient condition for P = Pi is (a) Pio = Pi and (b) P = Pio . 

Proof: 

(ii) Necessity: Assume P = P t . 

Then, from Theorem 2 (i) and Lemma 8, 

Pio = Pi > 
while, from Theorem 1 (i) and Lemma 9, 

Po = Pio . 

Hence, (a) and (b) follow immediately from Theorem 2 (ii) and 
Theorem 1 (ii) respectively. 

Sufficiency: Obvious since P = Pio and Pio = Pi imply 

Po - Pi ■ 

(i) Dichotomy: Assume that P and P x are not equivalent. 

Then, it follows from the sufficiency part of (ii) as well as from 
Theorem 2 (i) and Theorem 1 (i) that, at least, either 

Pio _L Pi or Po J_ Pio . 

Then, from Lemma 8 and Lemma 9, we have 

Po J. Pi . 

Thus, if Po and Pi are not equivalent, then they must be singular. 

(iii) Radon-Nikodym Derivative: From Lemma 3 (iii) and Lemma 2 
(iv), in conjunction with (43) and (47), we have 

dPi 
dP 



= exp < X) 2 ( 1 .) "' ~ * log pi 

+ 7, (vi + f) + 7. (ii + !)]} , a.e. (Po). 



(48) 
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Since P = Pi => Pa = Pio and Pio = Pi according to (ii), it follows 
from Theorem 2 (iii) that 



StO-s)"'-*"] 



- log pi\< oo, a.e. (P G ). 

Hence, the remainder of the exponent of (48) converges a.e. (Pa). This 
proves (iii). 



Corollary I : If P = Pi and 



< «, 



then 



df 
dP 






:,) i M* + f 



§■ 



a.e. (ft). 



Proof: This follows from Corollary 1 of Theorem 2 and Theorem 3 (iii). 

Corollary 2: If there exists a bounded, self-adjoint operator H on £ 2 (0,1) 
satisfying (40), and Rq~ m 6 £2(0,1), then 



(i) Po- Pi, 

dP 
dP„ 



'") w;T := (II P*) ex P 2(-' : - '«i , H(x - mi)) 



1 , wo + mi D -1 
I- I X — - , Ro m 

(iii) /r-„(£ 2 (0,l)) = #,(£ 2 (0,1)). 



a.e. (Po), 



Proof: 

(i) The assertion is an immediate consequence of combination of 
Theorem 3 and Corollary 2 of Theorem 2. 
(ii) Note 

d.Pi dPi dP 1Q . . 

d~p = dp; a dK> & - eAPoh 

Then, the assertion follows upon combination of Corollary 2 of Theorem 
2 and the corollary to Theorem 1. 
(iii) From (40), 
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& (£2(0,1)) = [Bt(HBi + 7)](£ 2 (0,1)) C R (£ 2 (0,1)), 
/2o(£»(0,l)) - [Ri(I ~ HR )](£i(0,l)) C Bi(£ 2 (0,l)). 
Hence, the assertion follows. 
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